Moment information and entropy evaluation for probability densities
نویسندگان
چکیده
Howmuch information does the sequence of integer moments carry about the corresponding unknown absolutely continuous distribution? We prove that a reliable evaluation of the corresponding Shannon entropy can be done by exploiting some known theoretical results on the entropy convergence, uniquely involving exact moments without solving the underlying moment problem. All the procedure essentially rests on the solution of linear systems, with nearly singular matrices, and hence it requires both calculations in high precision and a pre-conditioning technique. Numerical examples are provided to support the theoretical results. 2011 Elsevier Inc. All rights reserved.
منابع مشابه
Extended inequalities for weighted Renyi entropy involving generalized Gaussian densities
In this paper the author analyzes the weighted Renyi entropy in order to derive several inequalities in weighted case. Furthermore, using the proposed notions α-th generalized deviation and (α, p)-th weighted Fisher information, extended versions of the moment-entropy, Fisher information and Cramér-Rao inequalities in terms of generalized Gaussian densities are given. 1 The weighted p-Renyi ent...
متن کاملCramér-Rao and moment-entropy inequalities for Renyi entropy and generalized Fisher information
The moment-entropy inequality shows that a continuous random variable with given second moment and maximal Shannon entropy must be Gaussian. Stam’s inequality shows that a continuous random variable with given Fisher information and minimal Shannon entropy must also be Gaussian. The CramérRao inequality is a direct consequence of these two inequalities. In this paper the inequalities above are ...
متن کاملAn Alternative Method for Estimating and Simulating Maximum Entropy Densities
This paper proposes a method of estimating and simulating a maximum entropy distribution given moment conditions based on MonteCarlo approach. The method provides an simple alternative to conventional calculation methods of maximum entropy densities which involve complex numerical integration and are subject to occasional failure. We first show that maximum entropy density on a random sample co...
متن کاملModeling of the Maximum Entropy Problem as an Optimal Control Problem and its Application to Pdf Estimation of Electricity Price
In this paper, the continuous optimal control theory is used to model and solve the maximum entropy problem for a continuous random variable. The maximum entropy principle provides a method to obtain least-biased probability density function (Pdf) estimation. In this paper, to find a closed form solution for the maximum entropy problem with any number of moment constraints, the entropy is consi...
متن کاملProbability Density Function Estimation using theMinMax
| The problem of initial probability assignment consistent with the available information about a probabilis-tic system is called a direct problem. Jaynes' maximum en-tropy principle (MaxEnt) provides a method for solving direct problems when the available information is in the form of moment constraints. On the other hand, given a probability distribution, the problem of nding a set of constra...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Applied Mathematics and Computation
دوره 218 شماره
صفحات -
تاریخ انتشار 2012